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Evaluation of Communicative 
Competence: The ACTFL Provisional 
Proficiency Guidelines 


SANDRA J. SAVIGNON 


THE FOREIGN LANGUAGE TEACHING PROFESSION, 
more than any other it seems to me, is in per- 
petual search for new slogans.! I recall the com- 
ment of a colleague back in 1971, when I was 
a newcomer to the profession and interested in 
exploring the concept of communicative com- 
petence.? “Communicative competence,” he 
said to me, “that'll be a good topic for a year 
or two. Then what are you going to do?” 
My colleague did not foresee the exploration 
and discussion that would ensue. Today, more 
than a decade later, interest in the concept of 
communicative competence bas not only rof 
waned, it continues to grow and has led to the 
elaboration of descriptive models that have in 
turn provided frameworks for further research 
into the nature and acquisition of second-lan- 
guage proficiency.® The pre-eminence of com- 
municative competence as a focus of discussions 
of second-language teaching and evaluation 
was nowhere more apparent than at the Octo- 
ber 1984 TOEFL Invitational Conference at 
the Educational Testing Service in Princeton. 
The conference was held to consider revision 
of the TOEFL, a long established test of Eng- 
lish as a second language used to evaluate the 
English language proficiency of foreign appli- 
cants to US colleges and universities and ad- 


ministered around the world to approximately . 


450,000 candidates annually. The five papers 
that provided the basis for discussion each con- 
sidered the TOEFL from the perspective of 
communicative competence. They were 
authored by researchers in the US and Britain 
well-known for their contributions to a com- 
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municative approach to language teaching and 
testing.* 

The ETS/TOEFL conference is an impor- 
tant example of the heightened awareness in es- 
tablished testing programs of the need to evalu- 
ate language use, as opposed to knowledge of 
discrete surface linguistic features. This aware- 
ness is due in great part to concerns expressed 
by classroom teachers and other test users and 
supported by research in language acquisition 
and evaluation. As a result, attention has now 
tumed to proposing revisions in both format 
and content of the numerous large-scale tests 
developed in the 1950s when both structural 
linguistics and behaviorist psychology were at 
their peak of influence. 

Recent efforts by ACTFL to establish and 
to promote a Foreign Service Institute (FSI) 
type oral interview and evaluation scale, adapt- 
ing the scale to include receptive and produc- 
tive dimensions of language use in both written 
and oral channels, were prompted by a similar 
concern for language use, for communicative 
competence. However, in establishing the eval- 
uation guidelines and in secking to bring atten- 
tion to their existence, ACTFL has chosen to 
emphasize what appears to be a new slogan, 
proficiency, Promotion of the “ACTFL Provi- 
sional Proficiency Guidelines” has been built on 
the distinction, popular in the 1960s, between 
tests of achievement, linked to the instructional 
content of a particular course, and those of pro- 
ficiency, based on a theory of the abilities re- 
quired to use language for communication.’ 

Notably absent from the literature promot- 
ing these provisional guidelines is reference to 
communicative competence as an underlying 
construct. Moreover, one senses not only a neg- 
lect of the long linguistic tradition reflecting a 
concern for language in context, but, on the 


part of at least some of those promoting the 
guidelines, an attempt to discredit the efforts 
made in the 1970s to bring this expanded view 


teachers, To give an example, the topical index 
for a major 1984 ACTFL publication, Teach- 
tng for Proficiency, the Organizing Principle, gives 
no mention whatsoever of communicative com- 
petence.* The volume itself does include at least 
one reference to communicative competence, 
but its tone is clearly one of disavowal. The 
term appears in quotation marks following a 
definition of proficiency that asserts the impor- 
tance of grammar: “Note the resurgence of the 
importance of grammaticality, minimized 
somewhat in the 1970s with the rhetoric sur- 
rounding the term ‘communicative compe- 
tence.’ ™ A similar, albeit oblique, reference is 
made in the introduction to the volume: *. . , it 
is scarcely fair to lead the serious students 
along, encouraging them to talk like Tarzan 
and then saying that future progress is unlikely 
if not impossible until they get their grammati- 
cal act together.” The editor goes on to warn: 
“Postponing linguistic accuracy is an approach 
that promises a terminal profile.”* The message 
for classroom teachers seems to be: audio-lin- 
gualism was once in, now it is out; communi- 
cative competence came along, but it, too, is 
now passé; the new bandwagon in foreign-lan- 
guage teaching is proficiency, so you should 
bop on board. If I were a classroom teacher, 
1 would be bewildered, if not annoyed, 

In the remarks that follow, I want: 1) to re- 
affirm the view of language represented by the 
term communicative competence as it has come 
to be used in linguistic and psychometric re- 
search; 2) to highlight the narrow and rather 
schizoid view of language use reflected in the 
“Provisional Proficiency Guidelines” being pro- 
moted by ACTFL; 3) to note the inadequacy 
of these guidelines in their present form as a 
basis for developing a syllabus or designing a 
curriculum. In so doing, my intent is not to dis- 
parage a potentially important initiative toward 
making the development of communicative 
skills a more integral part of school language 
programs. 1 am well aware of the interest gen- 
erated by the workshops that have been held 
to familiarize teachers with FSI (or Interagency 
Language Roundtable [ILR], as they are now 


known) -interview-and-evaluation-techniques 
and consider this participation of classroom 
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teachers important for future informed discus. 


sion of the issues involved. Rather, ] am re. . 


sponding to Liskin-Gasparro’s invitation: “The 
guidelines as published are still pro- 


visiona]. An important next step will consist of 


close inspection by the profession and sugges- 
tions for change.” My intent is to underscore 
the.tension that presently exists between the-en- 
couragement of second-language usc, or func- 
tional proficiency, on the one hand, and a re- 
newed emphasis on discrete points of sentence- 
level grammar, or “accuracy,” on the other. 
‘This tension must be resolved if we are to move 
forward in the development of teaching and 
testing materials. 


LANGUAGE AS COMMUNICATION 


Let us look first at the term communicative 
competence, While linguists and psychometri- 
cians concerned with evaluating language pro- 
ficiency are far from reaching a consensus on 
exactly what communicative competence is, let 
alone how it is acquired, there is a general 
understanding that it includes far more than 

. Sentence-level grammar, or grammatical compe- 
tence, Other components that have been pro- 
posed in addition to grammatical competence 
include sociolinguistic competence, requiring an 
understanding of the social context in which 
language is used, discourse competence, requiring 
an understanding of how utterances are strung 
together to form a text, a meaningful whole, 
and strategic competence, requiring strategies for 
making the best use of what one docs know 
about how a language works in order to inter- 
Pret, express, and negotiate meaning in a given 
context.1° The context of situation, a concept in- 
troduced by Malinowski in 1923, figures 
prominently in the subsequent work of Firth, 
Halliday, and Hymes, linguists who have made 
significant contributions to our understanding 
of texts (both written and oral) and how they 
convey meaning.'! To quote Halliday: “Lan- 
guage comes to life only when functioning in 
some environment. . . . We do nof experience 
language in isolation —if we did we would not 
recognize it as language —but always in rela- 
tion to a scenario, some background of persons 
and actions and events from which the things 
which. are_said.derive-meaning.”!? 

Linguists and psychometricians are similarly 
in agreement on the integrative, compensatory 
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nature of communicative competence. One 
criticism of integrative tests has been that they 
are “too vague” and insufficiently “diagnostic,” 
that we cannot tell precisely what they meas- 
ure. This nature, as Oller has pointed out, is 
no fault of the tests but reflects the underlying 
language proficiency they seek to measure. 
“Answering the question, ‘How much language 
proficiency is necessary to understand what 
goes on in a college-level course? is like answer- 
ing the question, ‘How much light is sufficient 
to find your way out of a forest?’ It depends 
hardly at all on any particular discrete ‘rays’ of 
light, and the same sort of thing can be said 
about ‘points’ of grammar."!? 

Reference to components has been useful in 
developing descriptive models of communica- 
tive competence, representations of the types 
of knowledge and skills needed for communi- 
cation in a given setting. Such descriptive 
models provide a basis for research that 
attempts to show how components of communi- 
cative competence are interrelated psychologi- 
cally to form a set of statistically identifiable fac- 
tors. However, it remains to be shown that the 
components used by theorists to describe lan- 
guage are psychologically distinct, suggesting 
that a learner can learn them separately or can 
learn more of one than another.'* 

Nothing in the preceding discussion of the 
need to interpret language in its context of 
situation and of the integrative, compensatory 
nature of language proficiency should be taken 
to mean that grammar is unimportant, or that 
communicative competence does not include 
grammatical competence. To my knowledge, 
no responsible theorist or researcher has ever 
made such a claim. Without some degree of 
grammatica) competence, there can be no com- 
munication, However, communicative compe- 
tence certainly requires more than knowledge 
of surface features of sentence-level grammar. 
And educated native-speaker grammatical 
competence is not necessary for communica- 
tion. 


LANGUAGE USE: A NARROW VIEW 


Why, then, in a campaign to encourage 
spontancous language use in US foreign lan- 
guage classrooms, a campaign that claims to 
have been inspired by the functional linguistic 
tradition, is there such emphasis on discrete 


points of grammar, or “accuracy?” The answer 
lies, it seems to me, in the origin of the For- 
eign Service Institute/Interagency Language 
Roundtable (FSV/ILR) rating scale on which 
the ACTFL guidelines are based, and in the 
unresolved tension within the profession be- 
tween a perceived need to teach for communi- 
cation, on the one hand, and on the other, the 
discrete-point, American structuralist view of 
language that pervades not only teaching mate- 
rials, but the experiences that many teachers 
and methodologists themselves have had as 
classroom learners. 

To illustrate, the foreword to Teaching for Pro- 
ficiency, the Organizing Principle, characterizes 
“function,” “content,” and “accuracy” as the 
“watchwords” of the “proficiency movement.”!5 
*Accuracy” is subsequently defined as “the degree 
of accuracy to which representative grammatical fea- 
tures are mastered “'* Assignment of ratings on 
the original FSI scale was made on the basis 
of separate, weighted scores assigned to discrete 
linguistic features. Of all the features evaluated, 
the grammar scale received the heaviest weight- 


ing, followed by vocabulary, comprehension, fluency, 
and, finally, accent, which had the lowest. A 


* statement in the /LR Handbook on Language Test- 


ing (1982) leaves no doubt that adoption of edu- 
cated native-speaker grammatical norms was 
and continues to be the single overriding con- 
sideration in the assignment of a rating: 

For years, the [FSIILR]} Definitions have served as 
the basic introduction to the system. However, their 
compact wording and their non-separation of func- 
tion, content and accuracy lead some readers to over- 
look the necessity for relating all three aspects at each 
level. The Definitions’ text contains two-thirds func- 
tion and content statements and one-third accuracy 
statements, and it is often unclear to first-time 
readers that the accuracy statements override the athers.*? 


As for the “educated native speaker” norm, 
the Handbook explains that “educated” refers not 
to holding a degree or diploma, but to “using 
the speech or language generally associated 
with educated speakers in the native country.” 
Preference is thus given for the language variety 
of a particular social group within the second- 
language culture. 

The Handbook goes on to make it clear that 
many native speakers would not qualify as a 
5, the highest rating given: 


Finally, we return to the point whether a “native” 
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sovernment not only wants to know whether a per- 
‘wort will Be accepted as a “native” speaker, but at what 

level. Thus, it is Perfectly possible to have “native” 

housewives who are "Ss"; semi-educated “natives” 
who are °3 + s"; etc. In any society there is not a 

majority of "53,710 

In its view of language use, the US govern: 
ment's foreign-language rating system is thus 
Clearly elitist. We must ask Ourselves if this is 
the view we wish to adopt for our school pro- 
grams. 

A further weakness of the FSI/ILR interview 

and rating scale as a means of evaluating com- 
municative competence lies in the interview for- 
mat itself. Those who are familiar with the CLA 
videotape that has been used in ACTFL-spon- 
sored workshops to familiarize participants with 
rating levels and evaluation Procedures know 
that the format demonstrated is principally that 
of an interrogation, with both a Native-speaker 
interviewer and an evaluator present. The 
lestee is “on the Spot,” as it were, to answer 
questions and engage in role play designed to 
check range of vocabulary and to elicit apeci- 
fied grammatical structures: {A “Grammar 
Grid” has been Prepared for each language, 
showing which constructions must be used con- 
sistently in order for a testee to qualify for a 
given rating.) “What would you do if you won 
a five million dollar lottery prize?” What did 
you used to do summers when you were a 
child?” Among the Many contexts nof sampled 
are small group discussion, Playing a game, or 
conducting a survey, contexts requiring very 
different discourse strategies, strategies that 
teachers often encourage, or would like to 
encourage, in their classrooms. 

A final example of what I have characterized 
as the rather schizoid nature of the “Provisional 
Proficiency Guidelines” can be seen in the way 
the FSI rating scale has been adapted for use 
in other than oral interview settings. The 
ACTFL guidelines include ‘Separate scales for 
speaking, listening, reading, and writing, with 
culture as a fifth and separate “skill.” For any- 
one who understands communication as the 
interpretation, expression, and negotiation of 
meaning within a given context or situation, 


_notional emphasis-on language in context for 
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this identification of four “skills® detached from 
culture is Perplexing, to say the least, More- 
Over, it runs counter to all the efforts Yhat in 
recent years have gone into making "small-c” 
culture, Culture in the anth: i 

E term, an integral part of second-language 
programs., 


CURRICULUM DEVELOPM ENT 


‘The third general issue that I should like to 
raise with respect to the ACTFL guidelines and 
the evaluation of communicative competence 
has to do with their suitability as a basis for cur- 
riculum development, Testing programs that 
emphasize communication are valued as much 
for the impact they have on instructional pro- 
grams as for the information they yield regard- 
ing learner achievement, For example, in de- 
scribing the testing units that she and her col- 
leagues in the Modern Language Centre of the 
Ontario Institute for Education have developed 
for use in province-wide assessments of the 
communicative performance of immersion stu- 
dents, Swain emphasizes that a guiding prin- 
ciple in test construction was to work for wash- 
back: “It has frequently been noted that 
teachers will teach to a test; that is, if they know 
the content of a test and/or the format of a test, 
they will teach their students accordingly. This 
is not Particularly surprising, given the fre- 

quency with which educational administrators 
use tests, legitimately or Not, to judge teacher 
eflectiveness."19 
A similar point is made in the preface of the 
ARELS Oral Examination, a test of English 
language proficiency for foreign applicants to 
British universities: "From the beginning the 
examination was regarded as a means as well 
as an end in itself. That is to say, it was con- 
sidered no more important than the changes it 
would generate in language training by direct- 
ing it toward more modern and practical 
needs,"70 
Drafters of the ACTFL guidelines have 
made explicit their intention that the guidelines 
serve as a basis for curriculum development. 
Not surprisingly, in descriptions of just how 
such a curriculum might be planned, one finds 
a tension similar to that noted in the guidelines 
themselves, Liskin-Gasparro describes the 
guidelines as an “attempt to take the functional/ 
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a particular purpose and apply it to the aca- 
demic setting in the United States. Their point 
of departure was the proficiency-based ap- 
proach of the funcfional/notional syllabus 
rather than the structural orientation of the 
grammatical syllabus."*' Yer in the same 
ACTFL publication, Higgs asserts that “since 
the grammar curve nears its peak at the 2+ 
level, proficiency theory predicts that a gram- 
matical syllabus is not only defensible, it is 
indispensable."*7 

Omaggio summarizes a curious compromise 
proposed by Higgs and Clifford, one that 
clearly misrepresents not only the concept of 
communicative competence, but what is known 
about the second-language acquisition process: 
"a ‘communicative’ track could be designed that 
would focus on the development of vocabulary, 
stock phrases, and a certain level of Duency 
without much concern for grammatical accu- 
racy. A second ‘linguistic competence’ track 
might be designed for those who hope even- 
tually to use the language in their profession.” 
Along with the proposal for a two-track option 
comes the warning that the “communicative” 
track is “terminal”; that is, learners who start 
down a path of “Duency without much concern 
for grammatica) accuracy" will never be able 
to qualify for more than a 2/2 + FSI/ILR rating 
(Advanced/Advanced Plus on the ACTFL 
scale). ® 

Whether or not the claim is true makes little 
difference, since it is doubtful that anyone 
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1A revised version of a paper presented at the Annual 
Meeting of the American Council on the Teaching of 
Foreign Languages, Chicago, November 1984. This article 
is being published simultancously in Tir Canadien Modern 
Language Review and The Modem Language Journal 

"Sandra J. Savignon, "A Study of the Effect of Training 
in Communicative Skills as Part of a Beginning College 
French Course on Student Attitude and Achievement in 
Linguistic and Communicative Competence," Diss., Univ, 
of Illinois, 197}; expanded and published as Communica- 
tive Competence’ An Experiment in Foreign Language Teaching 
(Philadelphia: Center for Curriculum Development, 1972), 

Examples of this research are cited below. See, in par- 
ticular, notes $, 10, 13, 14, 19, and 20. 

‘These papers and a summary of the discussion that fol- 
lowed their presentation will be published by ETS in a forth- 
coming research report. They include “Explaining Com- 


would seriously consider implementing the kind 
of program referred to here as *communica- 
tive.” Be that as it may, 2/2 + is the proficiency 
level attained by most college foreign language 
majors, including future teachers, by the time of 
graduation.™ Keeping in mind that presently 
no more than two percent of US secondary 
school students take morc than two years of a 
forcign language, we should ask ourselves how 
realistic it would be to design programs for that 
perhaps once-in-a-teacher’s-lifetime student 
who might some day wish to qualify for an ILR 
rating of 3, if indeed we knew that such a stu- 
dent required a special program. 

Until these issues are more carefully con- 
sidered through continued research and discus- 
sion, caution should be exercised in making 
recommendations regarding curricula. For 
Now, it seems wise to stress the provisional nature 
of the ACTFL guidelines, to continue to refine 
them, and to gather data and report to the pro- 
fession on not only the reliability of the meas- 
ures, but, more important, on the validity of their 
underlying construct. Testees should include 
not only learners in core academic foreign lan- 
guage programs but those in immersion and 


„other more naturalistic environments. In the 


meantime, the guidelines should not be used 
for making claims regarding the nature and 
sequence of acquisition; they should also not 
be promoted on a large scale as a basis for pro- 
gram development and earner evaluation. 


municative Competence” (Christopher Candlin, Univ. of 
Lancaster); “The Meaning of Communicative Competence 
in Relation to the TOEFL Program’ (Sandra J. Savignon, 
Univ. of Ilinois); “The TOEFL as a Measure of Communi- 
eative Competence" (Lyle Bachman, Univ, of Ilinois); 
“Communication Theory and Testing: What and How?” 
(John W. Oter, Jr., Univ. of New Mexico); and “Com- 
municative Competence and Tests of Oral Skills” (Dan 
Douglas, Wayne State Univ.). 

*For further discussion of the achievement/proficiency 
distinction, see Sandra J. Savignon, Communicative Compe- 
tence, Theory and Classroom Practice (Reading, MA: Addison- 
Wesley, 1983), pp. 245-46. For the “ACTFL Provisional 
Proficiency Guidelines,” see Teaching for Proficiency, the 
Organizing Principle, ed. Theodore Higgs (Lincolnwood, IL: 
National Textbook, 1984), Appendix A 

Higgs (note 5 above). 

*Alice C. Omaggio, “The Proficiency-Oriented Class- 
room,” Teaking for Proficimsy, the Organizing Principle (note 
5 above), p. 45. 
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NALLD Journal Seeks Editor 


THE INTERNATIONAL ASSOCIATION OF LEARNING 
Laboratories (IALL) is Presently looking for an 
editor-in-chief for its NALLD Journal. The edi- 
tor needs experience in the use of technology 
in language learning and knowledge both of 
editing and administration, Above all, (s)he will 
need to be dynamic, innovative, and willing to 
commit sufficient time and energy to ensure 
that the NALLD Journal! continues to Provide 


a valuable service to IALL members. The edi- 
tor-in-chief will be responsible for coordinating 
an editorial staff (managing edit 
editor, and business manager). Applications or 
nominations for the Position should be seni by 
15 July 1985 to Roger Sanchez-Berroa, Presi- 
dent, International Association of Learning 
Laboratories, Wesleyan University, Middle- 
town, CT 06457, USA, 


or, associate 


